IN THE CLAIMS : 

Please amend Claims 1, 14, 18, 29, and 30 as follows. A marked-up version 
showing the amendments to the claims is included in the attached APPENDIX. For the 
Examiner's convenience, all of the pending claims are presented, regardless of whether the 
claims is currently being amended. 



'^^^ ^\ ^ 1. (Amended) A us^interface apparatus comprising: 

a first sensor attached ro a first portion of a body of a user; 
a second sensor attached t\a second portion of the user, which is different 
fi-om the first portion; 

means for analyzing an action of {he user on the basis of a relative position 
of the second portion with respect to the first portioi\which is detected by said first and 
second sensors, and for generating action information corresponding to the action of the 



A 



user; and 

determination means for determining a user ins^^f^ction corresponding to the 
generated action information. 



2. The apparatus according to claim 1, wherein the first portion is a head. 



3. The apparatus according to claim 1, wherein the second portion is a hand. 
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4. The ajroaratus according to claim 1, wherein said first sensor detects a 
location/posture of the firsVportion. 

5. The apparatus according to claim 1, wherein said second sensor detects a 
location and posture of the second portion. 

6. The apparatus accordingsto claim 1, wherein the action information 
includes information which pertains to a statk change of the second portion with respect to 
a location of the first portion, and information which pertains to a location change velocity 
of the state change. \ 

7. The apparatus according to claim 1, wnferein the action information 
includes information which pertains to a state change of theVecond portion with respect to 
a location or location/posture of the first portion, and information which pertains to a 
location change \ 

acceleration of the state change. \ 

8. The apparatus according to claim 1, wherein the action raformation 
includes information which pertains to a posture of the second portion with^espect to a 
posture of the first portion. \ 
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9. The a^aratus according to claim 1, wherein the action information 
includes information whicK pertains to a moving direction of a location of the second 
portion with respect to a posture of the first portion. 

10. The apparatus according to claim 1, further comprising: 

means for storing a valuXof the relative position of the second portion with 
respect to the first portion, and a plurality of state values which are defined in advance as a 
result of transition of the value; and \ 

means for storing a plurality of different user instruction values 
corresponding to the plurality of state values. \ 

1 1 . The apparatus according to claim 1 , whVein said determination means 
decomposes the determined user instruction into a plurality ordnstruction operands, and 
outputs the operands. \ 

12. The apparatus according to claim 1, wherein when smd generation 
means determines that a relative relationship between a location/posture of a head detected 
by said first sensor, and a location/posture of a hand detected by said seconaysensor 
indicates an action of the user whose line of sight is pointing to a predetermined portion of 
the hand, said determination means outputs a user instruction for outputting an operation 
guidance. \ 
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13. The apparatus according to claim 1, further comprising a third sensor for 
detecting a bent angle of a finger. 

14. (Amended) A gaisne apparatus comprising: 
a first sensor for detecting a location/posture of a head of a player; 
a second sensor for detecting a location/posture of a hand or arm of the 

player; 

means for estimating an action oKthe player on the basis of a change of a 
relative location/posture of the hand or arm with reject to the location/posture of the head, 
which are detected by said first and second sensors; 

means for outputting a player command corresponding to the estimated 

action. 

15. The apparatus according to claim 14, further comprising display means 
for displaying an image of a game scene in front of the head of the mayer for the player. 

16. The apparatus according to claim 14, wherein said di^lay means is a 
head-mounted display. 

17. The apparatus according to claim 14, wherein three steps including 
preparation, execution, and return steps, are prepared for the player command, an^the 
steps are respectively defined as: 
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a preparation action step for the player command when the location of the 
hand of the player moves toya position behind a position in front of a face of the player; 

an execution step for the player command when the location of the hand of 
the player moves forward from a rear position after the preparation action; and 

a return action step foXthe player command when the location of the hand of 
the player returns to a position of the face of the player after the forward movement. 

18. (Amended) A user interfaceonethod for outputting a user 
instruction to a predetermined apparatus or program, comprising: 

the step of detecting a location of a mst portion of a body of a user and a 
location of a second portion of the user, which is differemt from the first portion, by using 
first and second sensors attached to the user; and \ 

the step of determining a user instruction by fbalyzing an action of the user 
on the basis of a relative position of the second portion with respect to the first portion, 
which are detected by said first and second sensors, and outputting: the determined user 
instruction to the apparatus or program. \ 

19, The method according to claim 18, wherein said first and second sensors 
respectively detect locations/postures of the first and second portions. \ 



20. The method according to claim 18, wherein the first portion 
the user, and the second portion is a hand of the user. 



a head of 



21. The method\according to claim 18, further comprising the step of 
detecting information which pertains to a state change of the second portion with respect to 
a location or a location/posture of thk first portion, and information which pertains to a 
location change velocity of the state change. 

22. The method according to claim 18, further comprising the step of 
detecting information which pertains to a state cWige of the second portion with respect to 
a location or a location/posture of the first portion, Vid information which pertains to a 
location change acceleration of the state change. \ 

23. The method according to claim 18, furthV comprising the step of 
detecting a posture of the second portion with respect to a posWe of the first portion. 

24. The method according to claim 18, further composing the step of 
detecting a moving direction of a location of the second portion with respect to a posture of 
the first portion. \ 

25. The method according to claim 18, further comprising theVep of 
storing a value of the relative position of the second portion with respect to the terst 
portion, and a plurality of user instructions which are defined in advance as a result of 
transition of the value. \ 
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26. The method according to claim 18, wherein the output step includes the 
step of decomposing the determined user instruction into a plurality of instruction 
operands, and outputting the operands. 

27. The method according\o claim 18, wherein when it is determined that a 
relative relationship between a location/posmre of a head detected by said first sensor, and 
a location/posture of a hand detected by said second sensor indicates an action of the user 
whose line of sight is pointing to a predetermined portion of the hand, the output step 
includes the step of outputting a user instruction foXoutputting an operation guidance. 

28. The method according to claim 19, mother comprising the step of 
detecting a bent angle of a finger from a third sensor. 

29. (Amended) A computer readable storage medium, which stores a 
program of a user interface method for outputting a user instruction to a predetermined 
apparatus or program, storing: 

a program step of detecting a location of a first portion^of a body of a user 
and a location of a second portion of the user, which is different from t]fe first portion, by 
using first and second sensors attached to the user; and 
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a program step of determining a user instruction by analyzing an action of 
the user on the basis of a relative poshion of the second portion with respect to the first 
portion, which are detected by\said first and second sensors, and 

outputting the detVmined user instruction to the apparatus or program. 

30. (Amended) A gameVpparatus for displaying a computer graphics image 
in front of a field of view of a player, conrorising: 

a first sensor for detecting a location of a first portion of a body of the 
player; \ 

a second sensor for detecting a location of a second portion of the player, 
which is different fi-om the first portion; and \ 

game progress means for proceeding wfth a game by determining a 
command the player wants to input by analyzing a chang>e of a relative position of the 
second portion with respect to the first portion, which are detected by said first and second 
sensors, and executing the determined command. \ 

31 . The apparatus according to claim 30, wherein sMd first and second 
sensors respectively detect locations/postures of the first and second portions. 

32. The apparatus according to claim 30, wherein the firstportion is a head 
of the player, and the second portion is a hand of the player. \ 
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33. The apparatus according to claim 30, further comprising means for 
detecting information whi^ pertains to a state change of the second portion with respect to 
the location or a location/posKire of the first portion, and information which pertains to a 
location change velocity of the state change, and 

wherein the command is generated in further consideration of the detected 
velocity. \ 

34. The apparatus according tct claim 30, further comprising means for 
detecting information which pertains to a state change of the second portion with respect to 
the location or a location/posture of the first portiofa, and information which pertains to a 
location change acceleration of the state change, and \ 

wherein the command is generated in funher consideration of the detected 
acceleration. \ 

35. The apparatus according to claim 30, further iwmprising means for 
detecting a posture of the second portion with respect to a posture Vf the first portion, and 

wherein the command is generated in further consideration of the detected 
posture of the second portion. \ 
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36. The afroaratus according to claim 30, further comprising means for 
detecting a moving direction of the location of the second portion with respect to a posture 
of the first portion, and wherem the command is generated in further consideration of the 
detected moving direction of the location of the second portion. 

37. The apparatus acconiing to claim 30, further comprising a memory for 
storing a value of the relative position of the second portion with respect to the first 
portion, and a plurality of player commands which are defined in advance as a result of 
transition of the value. \ 

38. The apparatus according to claim M), wherein said game progress means 
decomposes the determined player command into a plurality of operands, and executes the 
command in accordance with the plurality of decomposed Vjerands. 

39. The apparatus according to claim 33, whereiiWhen a relative 
relationship between a location/posture of a head detected by said first sensor, and a 
location/posture of a hand detected by said second sensor indicates tlrat a line of sight of 
the player is pointing to a predetermined portion of the hand, \ 

said game progress means generates a player command forVutputting an 
operation guidance. \ 



• 



40. The apparatus according to claim 30, further comprising a third sensor 
for detecting a bent angle of a finger. 

41. The apparatus according to claim 1, wherein the action information 
further includes geometric information of the first and second portions in a reference 
coordinate system. 

42. The apparatus according to Vlaim 14, wherein said estimation means 
extracts geometric information of the first and second portions in a reference coordinate 
system, and estimates a player action on the basis opthe geometric information. 

43. The method according to claim 18, whq-ein the detection step includes 
the step of extracting geometric information of the first and se^cond portions in a reference 
coordinate system. 

44. The apparatus according to claim 30, wherein saidVame progress means 
further extracts geometric information of the first and second portions in^^a reference 
coordinate system, estimates an action of the player on the basis of the geametric 
information, and determines the conmiand the player wants to input on the b\sis of the 
estimated action. 
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45. An intJrface apparatus comprising: 

a first senso\for detecting a location or motion of a first portion of a body 

of a user; 

a second sensor fjir detecting a location or motion of a second portion of the 
user, which is different from the first portion; 

determination means for analyzing outputs from said first and second 
sensors and determining a command input by the user on the basis of patterns of the 
outputs from said first and second sensors\ and 

output means for outputting tl^e command determined by said determination 
means to an object to be controlled. 

46. The apparatus according to claimy45, wherein the first portion is a head, 
and the second portion is a hand. 

47. The apparatus according to claim 45, wnerein said first and second 
sensors respectively detect locations and postures of the first and second portions. 



48, The apparatus according to claim 47, wherein said first and second 
sensors respectively detect location change velocities, location change accelerations, and 
moving directions of the first and second portions. 
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49. The applaratus according to claim 48, wherein said determination means 
analyzes an action of the useiuising information of a change in location, the location 
change velocity, location change; acceleration, and relative moving direction of the second 
portion with respect to the first ponjon, and specifies a command corresponding to the 
action. 

50. The apparatus accordingVo claim 49, wherein said determination means 
has storage information which defines in advm^ce a relationship between the action of the 
user and the corresponding command. 

5 1 . The apparatus according to claim 50, wherein the command output firom 
said determination means is supplied to the object to be controlled, and an image 
corresponding to the command is displayed. 

52. A user interface method comprising: 
the first detection step of detecting a location or motion of a first portion of 

a body of a user; 

the second detection step of detecting a location or motion of a second 
portion of the user, which is different from the first portion; 

the determination step of analyzing outputs of the first and second detection 
steps and determining a command input by the user on the basis of patterns of the outputs 
of the first and second detection steps; and \ 
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the outpm step of outputting the command determined in the determination 
step to an object to be controlled. 

\ 

53. The methodVccording to claim 52, wherein the first portion is a head, 
and the second portion is a hand. 

54. The method according to claim 52, wherein the first and second 
detection steps include the steps of respeo^fively detecting locations and postures of the first 
and second portions. 

55. The method according to claim 54, wherein the first and second 
detection steps include the steps of respectively detWting location change velocities, 
location change accelerations, and moving directions of the first and second portions. 

56. The method according to claim 55, wheWn the determination step 
includes the step of analyzing an action of the user using infomiation of a change in 
location, the location change velocity, location change acceleration, and relative moving 
direction of the second portion with respect to the first portion, anq specifying a command 
corresponding to the action. 
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